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1  Research  Agenda 


Motivation.  The  area  of  real-time  scheduling  has  received  increased  attention  during  the  last 
few  years,  in  part  due  to  the  creation  many  recent  multiprocessor  and  distributed  applications 
demanding  real-time  performance.  Such  applications  include  robotics  [5],  multi-media  [3]  and 
music  [2],  These  applications  are  charcicterized  by  their  need  for  real  time  response,  heavy 
computational  load,  and  unpredictable  events  that  must  be  processed  in  a  timely  manner. 

The  specific  application  domain  addressed  by  this  research  concerns  multi-media  systems. 
Specifically,  it  concerns  the  real-time  synthesis  of  voice  and  music,  where  partially  ordered 
sequences  of  computations  and  communications  must  be  processed  under  given  time  con¬ 
straints.  We  are  investigating  the  dynamic  (on-line)  scheduling  of  action  sequences  triggered 
by  real-time  events,  where  multiple  action  sequences  and  different  independent  segments  of  a 
single  action  may  execute  in  parallel.  A  real-time  parallel  digital  audio  synthesis  system  serves 
as  a  concrete  example  of  such  an  application.  A  sample  real-time  event  in  this  application  is 
a  note  played  on  a  Musical  Instrument  Device  Interface  (MIDI)  keyboard. 

The  proposed  DPARTS  multiprocessor  scheduler  is  now  partially  implemented.  It  will 
perform  scheduling  in  an  event  driven  manner,  in  reaction  to  sequences  of  incoming  events. 
Furthermore,  DPARTS  will  have  the  ability  to  adapt  its  scheduling  during  execution.  Such 
adaptations  will  be  performed  in  accordance  with  user  specifications  that  address  the  actions 
to  be  taken  in  response  to  exceptions  like  deadline  failures  and  sudden  overloads.  The  intent 
is  to  have  DPARTS  adapt  its  schedule  to  maximize  some  global,  time-dependent  measure  of 
schedule  quality,  even  under  high  system  loads. 

Multi-media  and  Music  Applications.  Some  recent  research  has  addressed  the 
scheduling  and  real-time  processing  of  multi-media  applications  [3].  However,  such  research 
has  addressed  relatively  static  applications  like  the  transfer  of  successive  image  frames  across 
a  network  [1]  or  the  scheduling  of  a  music  application  with  some  fixed  number  of  tasks 
[2].  In  contrast,  we  are  addressing  multi-media  applications  that  are  highly  dynamic,  which 
means  that  applications  must  react  to  unexpected  or  unanticipated  external  events.  Such 
reactions  may  result  in  the  on-line  creation  of  additional  tasks  that  must  be  dynamically 
scheduled  in  reference  to  existing  task  sets.  Furthermore,  for  dynamic  music  programs  that 
react  to  unanticipated  human  inputs,  timing  constraints  have  to  be  stated  differently  from 
other  application  domains.  Namely,  it  is  not  natural  to  state  timing  constraints  in  terms 
of  start  times,  execution  times,  and  deadlines.  Instead,  novel  semantics  have  to  be  defined 
for  'deadlines’,  such  as  semantics  that  capture  notions  of  lateness  based  on  the  perception  of 
different  musical  instruments  by  the  listener.  For  example,  a  deadline  for  an  instrument  like 
a  drum  approximates  the  well-known  notion  of  hard  deadlines  [4]  because  drum  beats  must 
be  very  precise.  On  the  other  hand,  for  musical  tones  that  are  long  and  drawn  out,  such  as 
those  generated  by  string  instruments,  'softer’  deadline  semantics  are  appropriate.  We  are 
investigating  and  specifying  such  novel  timing  semantics  and  using  them  in  the  development 
of  efficient  on-line  scheduling  algorithms  and  schedulers  supporting  this  class  of  real-time 
applications. 
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Distributed  Multiprocessor  Scheduling.  The  scheduler  being  developed  in  this  re¬ 
search  IS  a  specific  example  of  an  operating  system  service  to  be  offered  in  future  parallel 
and  distributed  systems.  Part  of  this  research  will  address  the  issues  of  distributed  service 
design  and  implementation  currently  being  addressed  by  other  OS  researchers.  Specifically 
we  are  building  on  the  research  described  in  [6]  to  construct  the  DPARTS  scheduler  to  be 
internally  concurrent  so  it  can  be  easily  scaled  to  different  size  parallel  machines  and  to  vary¬ 
ing  application  demands.  This  implies  that  scheduling  is  performed  by  multiple  concurrent 
and  cooperating  tasks. 

DPARTS  Scheduling  Details.  Some  details  about  the  DPARTS  scheduler  further 
emonstrate  its  novelty.  As  stated  above,  each  external  event  may  trigger  a  sequence  of  pro- 
cesses  that  jointly  handle  the  event.  These  processes  must  execute  in  an  application-specific 
order.  DPARTS  must  have  information  about  (1)  such  orderings,  (2)  the  computation  time 
o  the  involved  processes,  and  (3)  about  possible  alternate  or  optional  processes.  We  are 
developing  a  directed  graph  representation  to  contain  such  information,  where  the  compu¬ 
tation  times  and  any  other  information  DPARTS  needs  to  know  about  processes  is  stored 
m  the  graph’s  nodes,  and  the  directed  edges  represent  the  processes’  order  of  computation. 
Processes  must  be  scheduled  concurrently  and  to  meet  real-time  constraints,  such  that  the 
graph  s  topological  order  is  maintained.  This  implies  that  multiple  parts  of  the  schedule 
graph  may  be  active  at  any  point  during  the  applications  execution. 

The  research  questions  addressed  in  this  work  focus  on  the  development  of  fast  heuristic 
algorithms,  on  experimentation  with  those  algorithms,  and  on  the  use  of  such  algorithms 
within  the  music  application  described  above.  We  are  not  developing  optimal  algorithms 
since  all  of  the  scheduling  and  assignment  problems  we  are  addressing  have  been  shown 
NP-hard.  Some  specific  questions  we  are  addressing  include: 


•  When  should  DPARTS  be  invoked?  What  is  the  required  frequency  of  DPARTS  invo¬ 
cation  with  respect  to  the  latency  of  scheduling  decisions  and  the  overheads  incurred 
by  scheduling? 

•  Should  DPARTS  have  the  option  of  rescheduling  existing  tasks  if  such  rescheduling  can 
result  in  the  successful  scheduling  of  otherwise  unschedulable  process  sequences? 

•  Deadline  semantics.  In  our  sample  music  application,  precise  deadlines  are  usually  not 
n^essary  in  order  to  produce  acceptable  results.  As  such  we  are  evaluating  what  type 
of  sematics  are  appropriate  for  addressing  the  application  we  are  scheduling. 


2  DPARTS  Status 


The  design  of  the  scheduler  is  nearly  completed,  with  implementation  currently  in  progress 
Through  initial  testing  we  have  determined  that  the  single  largest  degrader  of  performance  is 
e  Unix  signal  call.  The  elapsed  time  of  catching  and  responding  to  a  signal  takes  nearly  half 
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of  our  proposed  scheduling  cycle.  Based  on  these  results  our  scheduler  design  is  based  on  the 
non-preemptive  execution  of  threads.  The  scheduler  indicates  to  each  application  thread  how 
many  cycles  it  should  execute  before  giving  up  the  processor.  Through  the  use  of  cooperative 
task  scheduling  we  beUeve  that  much  of  the  performace  gained  will  be  retained. 

Preliminary  responses  to  the  above  stated  research  questions  are  as  follows: 

.  When  should  DPARTS  be  invoked?  The  DPARTS  scheduler  will  be  invoked  once 
execution  frame.  The  execution  frame  time  will  be  based  on  the  Just  Noticable 
ifference  Perception  Time  for  audio.  We  plan  to  start  with  a  5  millisecond  cycle  time. 
Also  a  DPARTS  scheduler  will  be  executed  on  each  processor  in  a  non-overlapping 
fashion  throughout  the  system.  Therefore,  initially  only  one  scheduler  will  be  active  in 
the  system  at  any  instant. 

•  What  is  the  required  frequency  of  DPARTS  invocation  with  respect  to  the  latency  of 
scheduling  decisions  and  the  overheads  incurred  by  scheduling?  And,  should  DPARTS 
have  the  option  of  rescheduling  existing  tasks  if  such  rescheduling  can  result  in  the 
successful  scheduling  of  otherwise  unschedulable  process  sequences?  Initially,  tasks  will 
not  be  reschedulable.  When  all  of  the  available  time  for  a  frame  is  filled,  then  the 
task  invocation  request  will  be  passed  to  the  next  scheduler  with  an  increasingly  higher 
priority.  In  this  manner,  even  low  priority  events  such  as  string  invocations  will' be 
scheduled  in  a  reasonable  time  frame. 

•  Deadline  semantics.  In  our  sample  music  application,  precise  deadlines  are  usually  not 
necessary  in  order  to  produce  acceptable  results.  As  such  we  will  evaluate  what  type  of 
sematics  are  appropriate  for  addressing  the  application  we  are  scheduling.  Furthermore, 
our  initial  model  for  incoming  events  will  assign  a  relative  priority  to  each  difl^erent 
instrument.  Within  each  time  frame,  available  tasks  will  be  scheduled  in  priority  order 
and  any  remaining  tasks  wUl  be  passed  to  the  next  scheduler  with  a  temporarily  higher 
priority  than  the  initial  priority  so  that  increasingly  earlier  events  will  be  scheduled. 

Digital  Audio  Synthesizer.  Our  sample  application,  a  parallel  digital  audio  synthe¬ 
sizer,  consists  of  a  number  of  interlinked  modules  that  communicate  by  passing  packets  of 
audio  samples.  The  application  embodies  modules  to  perform  the  following  functions: 

•  Digital  Audio  Generation  (sine  wave,  FM,  wavetable  lookup). 

•  Filtering  (a  generic  digital  filter  that  produces  high  pass,  low  pass,  bandpass,  and  notch 
filter  outputs). 

•  Amplification. 

•  Mixing. 

•  Effects  (chorusing  and  delays). 
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•  Output. 


The  user  will  specify  the  linkages  between  these  modules,  and  the  application  will  accept  input 
events  that  triggers  a  set  of  modules  which  produce  the  synthesized  digital  audio  output. 

Digital  Audio  Synthesizer  Status.  The  initial  Digital  Audio  Generation,  Mixing, 
and  Output  modules  are  complete.  In  addition,  the  Input  Event  Generator  that  converts 
MIDIFILES  into  a  stream  of  incoming  events  has  been  completed. 

Equipment  Status.  PCs  are  becoming  increasingly  important  as  actual  business  and 
research  computing  engines.  For  example,  much  of  the  research  in  Japan  addressing  real-time 
applications  (the  TRON  project)  is  based  on  PCs.  Therefore,  our  current  equipment  base  is 
a  PC  purchased  with  equipment  funds  allocated  to  this  work: 

•  90  Mhz  Pentium,  32  Megs  RAM,  17  in  SVGA  Color  Monitor. 

This  machine  is  attached  via  Ethernet  to  high  performance  computing  and  visualization 
engines,  as  well  as  to  MIDI  input  devices  and  to  multimedia  output  engines.  The  cost  of  the 
items  are  summarized  in  the  attached  expense  report. 
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